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ABSTRACT 

The information service performed by the Royal 
Institute of Technology handles requests from both university users 
and from industry. Fourteen data bases are currently used for SDI 
purposes. The system is of a general nature which permits inclusion 
of various data bases of completely different tape formats. Any 
combination of elements of a bibliographic record can be searched. As 
the profile maintenance program becomes an essential element when the 
number of profiles is building up, an on-line facility for updating 
has been installed. Special emphasis is placed on the principles for 
free text searching and on the problems of ordering the printout in 
such a way that it gives user satisfaction. At present a statistical 
approach is in operation. Since many data bases have keywords or 
other subject indicators, a combination of free text search of titles 
and keywords is often used. There is no significant deviation of the 
user's reaction when given printout from free text searches or from 
keyword searches. (Author) 
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SDI _0.btaitifd from Numerous Tape Servicos 
By B. V. Tell, Royal Institute of Technolo{;y, Stockholm 

Abs tract 

The information service performed by the Royal Institute of Technology 
handles requests from both university users and fron industry* Fourteer. 
data bases are currently used for SDI purposes* As the library also 
t pas on-line facilities for retrospective searches of six data bases 
in the ESRO/RECOM netv/ork, it has been found that retro-searches 
» usually initiate SDI-profiles for current awareness information* 

In 1967 the Institute initiated its ovm data baae '*L!echanical Enginee- 
ring - MECIIKK'* and begun a subscription to the tapes fron tYih Institute 
for Scientific Information. The purpose was primarily to provide a 
service to the S^/edish manufacturers in the neohanioal engineering 
field* However, the interdisciplinary nature of the ISI tapes attracted 
Interest from many users in the universities* The total number of 
profiles in I972 was 1 050. The Institute v/clcomes profiles from 
outside universities or companies through the interaediary of their 
own librarians* Hov?ever, most contacts are carried out directly t/ith 
the users* The back-up service giving full documentations is necessa- 
ry for keeping the interest of the users, and places a heavy burden on 
the regular library service* 

The report deals with the coverage, the operational and the performance 
functions* The system is of a general nature which permits inclusion 
of various data bases of completely different tape formats* Any com- 
bination of elements of a bibliographic record can be searched* As the ' 
profile maintenance program becomes an essential eleicent y,hen the 
number of profiles is building up, an on-line facility for updating 
has been installed. Thus, it is possible from a type-writer terminal 
to initiate, up-date and revise a profile r\ any time. Two such 
remote terminals are in operation, one 60 nlos from Stockholm, 

Special emphasis is laid upon the principles for free text searching 
and the problems to order the printout in such a way that it gives 
user satisfaction* At present a statistical approach is in op'^ration* 
Since many data bas^s have keyy/ords or other subject indicators, a 
combination of free text search of titles and keye/ords is often used^ 
There is no significant deviation of the user's reaction v/hen subjected 
to printout from free text searches or from keyword searches* 



^ ^ ^ 

Introcluotion 

V/ithin the overriding themo for thio lATUL-oeininar on "Corrjputor-Basod 
Informtion ServiooQ^^ ny role is to deal \/ith SDIj especially when it 
io given out from numerous tape oervioos* Perhaps I should indicate 
as a start that I am unable to accept that SDI is something apart from 
other computer-based information services ♦ Since our center has become 
a node in the ESRO and LIBRIS network, there is no longer a clearcut 
distinction betv/een a SDI-sex'Vice and retrospective searches, nor be- 
tween on-line and batch processing, 

^Although I shall focus interest on SDI service, much of what I say 
could also be related to retrospective searches. The on-line terminal 
in our center to the ESRO data banl: in Darmstadt, holding 1,2 Itil, re- 
ferences, serves often as an entry point for a retro search for a ques- 
tion which then is placed as a SDI-profile in batch processing mode, 
whereby the same number or wore data bases are used for giving an ex- 
haustive ansvrer. In total we run fourteen data bases for SDI purpose. 

During the years several tape services have been tested and some have 
been put into dperation. Various principles have governed the search 
procedures, and the output presentation* X propose, therefore, a tri- 
partite examination of the functions of the SDI bervice in its rela- 
tionship with 1) the funding agency v/hiich initially had to bear the 
costs as tape manufacturers oftmhave high price structures, 2) the 
operational center as having responsibility to give a good service and 
3) the users upon v/hose satisfaction the service depends: 

a) Its coverage function, the comprehensiveness of the service 

b) Its operational function 
o) Its performance function 

These functions are not mutually exclusive; there is considerable 
overlap between \7hat I call the operational and the performance func- 
tion, but they will help us to perceive what a SDI system performs. 

The covera/?e function 

In tho seven years the SDI service has been operating a number of tape 
services have been examined, tested and introduced, 5?he funding agency 
\7htch initially sponsored and supported this new type of service had 
especially in ^ind a service to industry, and talks begun v;ith the 
Federation of Svredish Industries about the coverage the SDI service 
should embrace. 



It sconod loGical to start off vdth an intordiociplinary data base, 
and the choico foil on the Scionco Citation Indox tapos, That had 
alGo tho advantage of heing x^apidly produced ^ so v/e could copo vdth ! 
the demand for novelty* Its bread oovorasOi especially by the oita- 
tions assured a serendipity factor of a certain nagnitude for those 
vrtio believed in orossfertilization over the discipline borders. 

Yet one would not contemplate this data base as being sufficient for 
industry, and even if the Institute for Scientific Information by 
and then included new Journals in the data base from the technologi- 
cal field, the coverage v/as too meagre to satisfy most of the users 
from industry. On the other hand, scientists in the university arua 
were extremely pleased with tho service \7hen their field of interest 
corresponded vdth the ISI coverage. 

Obviously, the gaping void especially in the mechanical engineering 
field had to be filled, thus the reason for starting up the M3CHEN 
data base. Some industries were intex^iewed about their needs to cover 
certain journals. As engineers and technicians out in industry are 
good in two -three foreign languages, it became apparent that besides 
English journals also German and French journals had to bo covered in 
these languages. Later, when v/e initiated the MOOD data bassi also 
Scandinavian journals had to be includedi but references to these were 
translated into English. Y/e found that with the equivalent to two full 
time clericals \yo had the capacity to cover around 200 journals. As 
smaJi notes, reviews and book critics seemed to be of interest to in- 
dustry, also references to these were included in the data base. 

The creation of the data bank gave us valuable experiences in string 
handling technique and how to build a general tape format, which will 
be dealt with later on. It also became a powerful argument against 
any overpriced commercially available tape service, and it served as 
an asset for barting with government created data bases in other count- 
ries. a?he production cost could be estimated thoroughly from the 60,000 
references we annually put on magnetic tapes. 

IviECHEIf and WOOD certainly filled gaps for the mechanical engineering 
industry and for the paper and pulp trade. When the computerised ver- 
sion of Engineering Index came on the market under the name of COLIPEi;- 
DEX, we included it in our service, despite Its badly spelled indexing 
terms and high error rate. One important sector of Swedish industry 
is the elootrotechnical and eloctronio field, vrhich demands wore not 
satisfied until we received IITSPEO. ^his vms done on a barting bases, 
not by offering our data base but by giving over our ABACDS-program 



tp.tho Institution of Elootrioal Engineero, which then for nany years 
served for its SDI sGr\''ioo in Great Britain, 

Wow that the property of the data bases acquired had beoome visible 
for many of the users, the demands for gap filling became more acute. 
The characteristics which guided our further choice has boon journal 
coverage I speediness and the price structure ♦ \7e have not bothered 
very wuch about the indexing procedure, which will be dealt v;ith later 
OYif or if the data base contained abstracts or not» 

Basically a reasonable coverage has been our main goal, because from 
the beginning our policy has been to answer the question of the user 
in the best way, disregarding how many data bases that are required^ 
This policy has not prompted us especially to advertise any specific 
data base as particularly valuable for a user. Instead, Bradford's law 
he.s been amply verified every time a user thinks he knows the suitable 
data base for his query. The most pertinent references oft©n stem froa 
unexpected sources. The nmaber of data bases used for different pro- 
files are shown in Table 1» 

The coverage function should certainly be looked at with some care 
keeping in mind the interest of the users. Thus, ERIC was acquired 
primarily as a data base which could serve the need of personnel 
managers in industry and organisers of enterprise training courses^ 
Later, it became obvious for us that general educators, teachers, re- 
search workers and counsellors \Tere the potential market for ERIC and 
around hundred profiles from this category were received. However, it 
was often found that pertinent references for these users were pulled 
out of data bases like IIJSPEO, ISI and COUPEITDEX, (Tell, Wessgren,. 
Hemborg 72) 

The present user population is covered with data bases to such an ex- 
tent that the .yery /rreat tar t feels assured of exhaustiveness in their 
scientific and technological fields ♦ On the other hand the demand from 
industry embraces also to a large extent commercial and economic infor- 
mation, an area where no specif ic acquisition decision has yet been 
made. Test tapes of PREDICAST and EXXOH are under study. 

The search capability and operational function 

Basically the creation of the data base MEOHSII grew out of the com* 
puteri2;ation of an acquisition list (Tell 68) which contained techni- 
cal reports and was supplemented by a K\70T-index (Koy-Vforld-Out-of- 
Titles). This index brought about a string handling technique which 



Table 1 , Number of nultiplo locationo of the 1030 SDI querioo. 
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257 


0,38 
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52 


0,30 
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737 


1 ,60 


ABIPC 


62 








WOOB 


39 




39 


1,10 


ERIC 


131 


1 


132 


0,96 


STAR & lAA 


7 




7 




PSTA 


54 


1 


55 


0,74 


STU 


1103 


22 


1130 


2,92 




4819 


94 


4913 





Roraark ; The Data Base Usage Factor has been calculated as the ratio of the 

l^^er of reforences listed in the printout to the users and the number 
of references in the data base trhich has been processed* It shov/s that 
specialised data baoos like METADKX or STU (Research prooccts sponsored, 
by the Sv/edish Board for Technical Development) have higher usage factors 
than bases of general nature like ISI. The figures have been calculated on 
a total of 1|003,eG0 references. 
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has been further elaborated. The prinary ^oal hac been to achieve a 
general system of £;rcat hospitality and flexibility (Tell^ Larsson a 
Lindh 70). Paradoxically, nuraorical analysis more than conputational 
linisuictics crept rapid] y into the syotens T7orl: v:hich had to pass 
throU;^h various stages of devolopccnt. By a more nasking-off technique 
vxherc the profile v;ords xrere kept in the meaory and the string of 
title TTords Tras read into the CPU in order to nask off coincidences, 

! 

we had cone far from just searching keyrrords in assigned fields, and 

i 

instead re trere able to search irords allov/ing for truncations both 
froia l^ft and right - a useful feature for searchln^j chemical compounds. 
*That technique v^s used for all letters in the alphabet. Even if ire 
could have improved that technique by using only 1o\t frequency letters 
v/e embarked instead on nevr search principles, nanely to make use of 

4 

tree- structures vhich gave a considerable advantage in speed over the 
Qaskix>g*-off program. 

As v;as shown by our collaborator (Dahl 70) that technique could also 
be iiaproved by using diagram trees instead of single letter trees. But 
in parallel we embarked on quite another avenue, namely taking advan- 
tage of the hash coding address technique (Hurray 68) v/hich broiJight 
down the search of a title string to milliseconds. 

The present system, VIRA, written by Rolf Larsson, is a symbiosis of 
the tree structure technique and the hash coding Trhich in fact means 
that with regard to CPU time the search procedure is almost negligable 
even for tens of thousands of references matched V7ith an equal nxuiber 
of search terns, compared with the print out time. (Zennaki 72)« 

The profile editing program for organiziiog the query terns and the 
search logic has also gone through various development stages, provi- 
ding for search on any data base, in any field, and using Boolean or ' 
simple arithmotical interpretation of the search question. 1 

i 

Various vyeighting schemes have been applied. The last year has been i 
one of strong development of an on-line profile program using a type- 
writer terminal and a dedicated disk of I3M 560-75 for batch processing ' 
as a transitory solution. Later a fully on-line dialogue profile progranj 
will be used. 

To operate a SDI service under a research granting council requires 
that our reporting and research applications alv/ays have to e>:pect a 
more thorough scrutinity of their novelty and experimental quality 
than v/ould be the case for an activity within the regular budget. This < 
has prompted us to seek advise and carry on a dialogue with interested 
^4^. r.^r..±irr^. tKi> n^turo of tho work h^M been such that we have 



found very fev/ knovdod^jable peoplo in the field '^ith v/hom a dialo^aio 
ni(sht fruitful* This has often been the case in tho systens develop- 
Kent field described above, instead tho scientific literature hue been 

i 

the main source of information. On the other hand, in the development } 

j. 

of the profile editing proffram there has frequently been a ground for 
more \ride discussions loading to constructive v/ork for improving the 
service* I 

i 

! 

The profile editing program is a key issue and on its flexibility i 

depends very much both the updatills?, procedure and the search perfor- [ 

mance. The Introduction of the on-line updating facility responded to I 
the need for a more labour saving procedure and immediate contact with 

the users* Many search options and alternative search strategies have } 

been successively included in the program in order to satisfy a variety | 

of needs. Still more development work should go into this area to ! 

achieve more adaptability and user friendliness. (Gluohowicz 71 •) I 

The yovrormanoe function i 

i 

Much of our attention has been given to the principles that govern - | 

j 

the performance of the system as viewed by the user, namely the eva- | 
luation he attributes to the output. The funding agency still regards 
our system as experimental, and it might bo of interest to disclose 
our present thinking about the system performance from the operational 
point of view \ve are taking. < 

In general, the fir^st step tovmrds an understanding about what kind ^ ; 
of literature there is in a set as a collection of documertts, or a 
file of references, is to develop a taxonomy. This has been tho basis i 
for the traditional usage of classification schemes and, later the 
various kinds of thesaurus approaches which are in use. This approach 
anticipates a more or less static collection wherefrom the taxonomy 
is developed in retrospect. 

However, for a SDI service where each new tape might include noxr oon- ; 
cepts we have furthermore to allow for change. Beforo the step to i 
develop a taxonomy can be taken, we might instead like to regard the 
representations of the items in the set per se* Uc^ually, the represen- \ 
tations consist of titles in natural language. The scientists have j 
many v/ays to represent their results of research in the form of titles. 
Our knowledge about the different \7ays in which it can be put is incon- 
plote, and at the present state of the art in semantics we will not 
try to embark on an avenue v/hioh would force us to resolve ambiguities, 



for inotanco, by transforming each title into its canonical form, be- 
cauoo we have much loss knov/lodgo about the significance of the diffe- 
rences betvioen the various kinds of representations other than the 
canonical that a title might be expressed into, j 

Not Much thinking* has actually gone into the manipulation of represen- ' 

tations in the title formi since most interest especially in computa- | 

tional linguistioa has concentrated on the processing of full text. i 

Although the theoretical basis is practically non-existent experimen- | 

ting has gone on in studying the behavio\ir of in^forxaation retrieval i 

systems based on title searcihes by the programming and operation of j 

t 

such systems v/heroby the results have been tested on the users. | 

Already 1967 ^Te started studies in this field and are still per- \ 

euing free text searching technique (Tell 72). By constructing the I 

profiles out of the user^s query, expressed in natural lang"uage, the j 

profile performs inductions, that is to say, it makes use of the ! 

context in which various words occur in titles, and by this it is pes- ! 

sible to arrive at a kind of interpretation of the title vrhich might \ 

be identical or different from what is arrived at v/hen indexing a title. I 

r 1 
The approach is identical to that of a scientist reading a list of con- j 

tents of a journal where every single words in the title more than the | 

complete context of the words might arise creative associations in his | 

mind. It can be said that th& program induces iDeanings of the searched ! 

titles by matching them against the v/eakly precoordinated profile .1 

' i 

words giving ample freedom for serendipity. 

The main idea for using the representations of scientific papers in 
the form of titles and using natural language searches, is that if the 
reprosentationmatchestho one expressed in the user's profile it is 
assumed that they are related. The matching does not need to be com- 
plete (Simon 69, Zadeh 72)« Kven reduntant matching can from an opera- 
tional point of view be regarded as giving a set of alternatives Tfhere 
a more correct matching might- be embedded.A continuous dialogue with 
the user and a revision of the profile takes place as a routine matter. 
Especially the introduction of an on**line profile updating technique 
has proved useful. By feedback from the user loar))ing might later be 
embodied in the system (Heaps 70) which will facilitate future matching. 

In order to introduce into the system an ability to arrive at gradu*- 
ally more correct matching, a statistical approach has been initiated 
that will servo to screen some of the alternatives (Sparok Jones c^K) 



If the system has diacoverod a match, even only a partial one it nay pro- 
on the assumption that it has detected a correct match whenever auch 
partial matching is present, and go into further stages of refine- 
mont by usins the v/eighting procedure. ' | 

V/hat happens is that we T/ant one hand to equate tho selectivity with i 
some kind of feedback of information from the environment, i.e. the i 
reactions of the user to an early output, on the other we want to check | 
the selectivity against the information inherent in a larger set of the j 
data base than Just the subset at hand for the SDI search, and fre- 
quency statistics of vrord occurrencies gives a hint for this purpose. 
However^ v/e are aware of the fact that vfe live in a higly redundant 
world, v/hy the number of coincidences which can be related to the sta- 
tistics in such a way that the statistics really prove effeotiv^ 
night seldom occur, still more so if we also take into account com- 
pound word expressions. But it woild be unwise to ignore this fasility 
which now is built into the system. 

So, for instance, a nelogisn would hardly or ever appear in the fre- 
quency listing of a large set of references built up froa earlier re- 
ceived tapes of a data base. However, as soon as a user is aware of a 
new word, it is entered into his profile, and can prove to, be effective 
when searching new tapes. Other document representations like keyv/ords 
or subject categories require a ' time-consuming intellectual' translation j 
process before the authority file can be decided upon which puts con- 
straints upon the rapidity with which such nelogisms can be picked up. 
That negates to a certain extent the advantage of using fast computer 
processing in the first place. 

Our experiments with the statistical approach has led to useful by- 
products. The ability of the system to produce frequency lists of words 
used in titles has given us the opportunity to submit such a list for 
all the ISO standards to the ISO/llIPCO Group when constructing the XSO 
Thesaurus. Council of Europe has also requested a frequency list of all 
title Y/ords used in 50,000 articles and reports in the ERIC data base, 
That list will serve as a basis for the construction of the EUDISKB 
Thesaurus (dECS/DOO 72/15), 

Hopefully, the natural language approach can also contribute to the 
knov/lGu.ce about how scientists v/rite titles, and serve as a basis for 
international rocomaendations about this. To this end I proposed to | 
trnosco/VirESIST to place a contract about this by an American consultant l! 
(UiaSIST/V/DC/72/1.2 p.' 5: 4d), j' 
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Conine ^^ok to iho oarlier point that in natural lans1^a^;e t^.any alter- 
native Gcntonces can bo phir;30d ao titles and ctill nean about the 
sane thins, it is obvious t'hat f'or quoationo of inter-disciplinary 
nature various data baoos must bo interrocatedt i'he fornulation of the 
query into a profile must, however, focuo on one data base at a time 
conoidering the terDinolo£;y ueed in the natural language. It seems 
therefore, necessary to develop a translation system betvreen various 
scientific disciplines reflecting the language in the data bases by 
the generation of vocabularies and concordances for words in natural 
language (Tell 7l)» The compilation of vrord frequency lists which vre 
have carried out for various data bases serves the purpose of giving 
an understanding about the specific scientific "jargon" used* 

Vfe have found that it is possible from the high frequency v.'ordo to 
determine the specificity of the "Jargon", and each data base has de- 
finitely its own "Jargon". Thus, if already vrhen dealing with natural 
text there are difficulties v/hen going from one data base to another, 
v/e can still use only one profile in free language. On the other hand 
if we also should deal v/ith the metalanguage which subject terms, de- 
scriptors, thesauinxa terms indicate, the translation problems become 
still more serious, especially since each data base has its own thesau- 
rus. 

It is clear that a blending of both the free text searching technique 
and retrieval based upon indexing in some fields seem to give optimal 
retrieval performance, in other fields the results are not conclusive. 
Both our own experience and that of Harwell in Great Britain has shovm 
that free text retrieval is as efficient as retrieval based on indexing 
the nuclear field. 

Inveotigafcions on the effect of the length^of the title-on the results 
of free text retrieval indicate that the opt i-ium is '100-1 50 characters 
(Olive & Terry 72), why v/e have found that enriching shorter titles to 
this range is advantageous in our data base liEGHiSN. 

A study has also been made about the relation between search logic and 
the title length. The results are inconsistent, but it seems to come 
out that \7hon the search logic is very strict, i.e. specifying a logical 
product of three concepts (AcVRiC) there seems to be a negative correla- 
tion, that is to say, if these conoopts occur they should corie rather 
closG together and the title should not be too long. 
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(ionoluolong 

Juot to sum up nnd add a few conuaente, I have tried to shov/ that the 
principle of ^ivinc oatisfaction to the demands of the users has proQp- 
tod us to acquire a number of data bases upon which the profiles are 
searohod, This has proved the Bradford's law. 

The dovolopment of the. free text search technique - from a mere masking, 
off technique to a symbiosis of tree-structures and hash oodinfj- have 
led to search costs which are more than competitive with those for in- 
doxed files. The free text retrieval has also an ooononiio advantage so 
' long as the costs of title enrichnent are less than indexing costs, 
and the retrieval results hitherto seem to be equally ffood. 2?he pro- 
filing costs for a free text profile is lower for a profile which has 
to be searched on i^veral data bases than for a profile based upon the 
thesaurus language of each data base. 

The fuzziness of the natural language approach is improved by the use 
of a weighting procedure based upon the word frequencies inherent in 
each data base* 

The user reactions do not deviate significantly when he is exposed 
to referenoGs pulled out by natural text searches compared with soar- 
ohes on index terms. r, 



Reforonoe a 

Toll, B.V. , V/ossgron, K, & Hocibore;, ^-^T^Ks \^use of ERIC tapes in 

Soandinavia, searching with thosa\i^s tertis and natural language, 
Straabourg, Council of Kuropo I972. (Mcs/doO 72:15) 

l^oll, B.V,, ABACUS - A3 Atomic Energy ConputorizGd User-Oriented 
Sorvicosi The meohantzation of bibliographic list production. - 
IEEE Trans, on Eng. V/rit, & Speech I96O, 11;2 p, IIO-II7, 

Tell, B.V. , Larason, R, is Lindh, R., Infomation retrieval \/ith the 
ABACUS programme - an experiment in compatibility. - lAG J 3(1970) 
4 p. 525-41. 

Dahl, R,, Past algorithms for natural text searches in SDI systems. 

GiJteborg, Chalmers Institute of Technology 1971. 49 .p. (Depart- 

nent of Computer Science. No. 71:02) (in Swedish) 
Murray, D.M,, A scatter storage scheme for dictionary lookups. Ithaca, 

Cornell 1968. 

Zennaki, H., Expos ^ VIRA. Paris, CURS-CDHS I972. 22 p. 

Gluchowioz, Z. , Selective dissemination of information - a trans~ 
disciplinary information retrieval system at the Royal Institute 
of Technology, Stooltholm. - lAG J (1971) 2 p. 13I-48. 

Tell, B.V., Free text retrieval and an ordering for the printout, 

Sthlm 1972. (TRITA-LIB-1 037) (Report to the ENEiV Tutorial Seminar 
on "Indexing vs. Free Text Retrieval, Studovik Juno I972.) 

Simon, H.A. , The science of the artificial. Cambr. , I-tass. I969. 

Zadeh, L.A. , Fuzzy languages and their relation to human and machine 
intelligenoe, - Man and Computer. Ed. by W. JJarois. Basel, Jfarger 
1972 p. 130-178. 

Heaps, H.S. & Ko, W.CC,, Automatic adaptive processing of questions 

in document retrieval, - ProcAmer. See, for Inform, Sciences 7 

(1970) p, 319-21. 
Sparck Jones, K. , Automatic keyvford classifioation for information 

retrieval. Lend, I97I. 253 P. 
Tell, B.V., Global and long-distance decision making. - In: Global 

and long-distance decision making, by K, Sarauelson, H, Borko, B.V, 
.Tell, P. Nader, R. Dubon, P.E. Irick, P,B. Mongar and H.P. Danmers. 

Stockholm, PID/TIi I972. 83 p. 
Olive, G, Terry, J., Title length vs. retrieval results using index 

terns and natural languages of titles, Harwell, AERE I972, 



